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Ms ,pp U cadon clauns pno„«y to U.S. phonal .ppUcdon 60/396, 874 fled July 16, 2002 
and is hereby fully incorporated by reference. 

? \ rvr,v OT TND OF T"* INVENTION 

1. FJEI r> OF TF T? TNVF.NTION 

The present invention relates to the field of transform functions in graphics processing. 

Portions of the disclosure of this patent document contain material that is subject to 
copyright protection. The copyright owner has no objection to the facsimile reproduction by 
anyone of the patent document or the patent disclosure as it appears in the Patent and 
Trademark Office file or records, but otherwise reserves all rights whatsoever. 

2. p a GROUND ART 



Colors on a computer display are produced by the computer through a series of graphics 
instructions that result in a blend of primary colors to produce a desired color. In many systems, 
20 the generated color does not look as intended on a computer display due to the nature of the 
re lationship between the monitor and the signals provided to it by the computer system. 
Although correcting schemes are available, many computer programmers do not take advantage 
of them. One result of this situation is a lack of optimal effect when performing certain data 
ttansform functions. This problem can be better understood by a review of how computers 
25 generate images on a display. 
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Computer display images are made up of thousands of tiny dots, where each dot is 
of thousands or millions of colors. These dots are known as picture elements, or 
"pixels". Each pixel has a color, with the color of each pixel being represented by a number 
value stored in the computer system. As is well known in the art, any color can be represented 
as a mixture of the three primary colors red, green, and blue (RGB). In typical systems, a pixel is 
described by three color components and an intensity component referred to as an "alpha- 
component. Systems that use this scheme are often called RGBA systems. 

A three dimensional display image, although displayed using a two dimensional array 
of pixels, may in fact be created by the rendering of a plurality of graphical objects. 
Examples of graphical objects include points, lines, polygons, and three dimensional solid 
objects. Points, lines, and polygons represent rendering "primitives" which are the basis for 
most rendering instructions. More complex structures, such as three dimensional objects, are 
formed from a combination or mesh of such primitives. To display a particular scene, the 
visible primitives associated with the scene are drawn individually by determining those 
pixels that fall within the edges of the primitive, and obtaining the attributes (e.g. color, 
intensity, texture) of the primitive that correspond to each of those pixels. The obtained 
attributes are used to determine the displayed color values of applicable pixels. 

Sometimes, a three dimensional display image is formed from overlapping primitives 
or surfaces. A blending function based on an opacity value associated with each pixel of 
each primitive is used to blend the colors of overlapping surfaces or layers when the top 
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surface is not completely opaque. The final displayed color of an individual pixel may thus 
be a blend of colors from multiple surfaces or layers. 

In some cases, graphical data is rendered by executing instructions from an 
5 application that is drawing data to a display. During image rendering, three dimensional data 
is processed into a two dimensional image suitable for display. The three dimensional image 
data represents attributes such as color, opacity, texture, depth, and perspective information. 
The draw commands from a program drawing to the display may include, for example, X and 
Y coordinates for the vertices of the primitive, as well as some attribute parameters for the 
10 primitive (color and depth or «Z» data), and a drawing command. The execution of drawing 
commands to generate a display image is known as graphics processing. 

The display of a computer system is thought of as a "frame" in which an image is 
presented. A computet display has a fixed number of display pixels arranged in an array. A 
15 typical display may have 1,024 columns of pixels in 768 rows for a total of 786,432 pixels. Each 
display pixel is represented by and associated with a memory location in a memory device 
known as a "frame buffer". The frame buffer stores the attribute information for each pixel on 
the display in that pixel's corresponding memory location. The contents of the frame buffer are 
provided to a digital to analog converter (DAC) to produce an analog signal used to drive the 
20 electron gun of a CRT display and energize the appropriate pixel location to display the desired 
pixel. 

There is a problem that arises in this system due to the nonlinear relationship between 
the signals provided to the display monitor and the performance of the monitor itself. The 
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DAC output is - intend *- that varies from 0 (no intenaity) to 1 (full intensity). Tne aigna! 
is pmvtded to the monitor to generate a vohage output from che months eiectron gun. The 
p Iobl em is mat .he urtenstty/voltage response curve rs no, Bnear. .n other words, if the inrensiry 
signal is .5, rhe ourpur of rhe monitor is nor half tntensity hnr something much less man ban. 
tod! images ge, very bngh, (high intensity) they took mnch darker man expected. The 
unship between tntensity signal and ontpnt voters known as the "gamma" - 
The prior at, has created a number of gamma cotrechon schemes to solve me problems 
presented by this nonlinear response. 

The amtples, soludon is to gamma correct me input da. to a monitor pnor to providhtg 
it m *. monitor. Thrs constats of applymg a funcdon to the data and is descrtbed by refemng 
ro Fignrea U meough 1C. Figure 1 A is a graph of me input to a monitor from the fmme buffer 
DAC Aayoncan.ee, me signal is kneac. Ftgure » is me acuta! response of a typical monitor 
,„ input. The graph shows tha, mere la an eaponenba, rdadonship P where I ts mtensity and „ 
„ a value between 2 and 2.5 depending on me monitor (a typical value of n is 2.2). Taking, for 
cample, an input of .5 mtenaity, me acmal output on the display win only be .5", - 0.21, This 
is less man one fourth of the matdmum intensity, instead of the desired one half. 

Figure 1C Olusttated a gamma cotrecdon curve mat can be applied to me intensity si^tal 
0 prior to sending trro the monitor. The cutve is the inverse of the gamma curve of Figure IB, or 
V. By correcting the signal with a funcdon cottesponding to me curve of Figure 1C, the 
output of the monitor will have a more linear reladonship as illustrated in Figure 1 A.. 
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Many graphics systems and computer systems currently include some type of gamma 
correction. However, often the gamma correction is not used. One reason for this is that the 
use of gamma correction can provide undesired results in certain conditions. For example, when 
there is a gradient of intensity in an image, the use of gamma correction can result in "banding" 
of the unage instead of a smooth transition. By disabling gamma correction, this bandmg effect 
can be avoided. To avoid the need for gamma correction, many graphics developers work in a 
p £e -gamma corrected envuonment where the colors and intensities are determined taking into 
account the nonUnearity of the output monitor. This is referred to as working in the "gamma 
space". Non pre-gamma corrected data is referred to as being in the "linear space". 

Although this pre-gamma coding, non-gamma corrected environment provides a 
solution for the banding problem, it creates a problem in the data transform stages of a graphics 
pressing system. One transform, for example, is the antialiasing stage of graphics processing. 

Aliasing refers to a set of visual artifacts caused by the discrete sampling of an image at 
fixed sample positions (,e. pixel positions). A typical artifact includes "staircasing" of lines, 
edges, and boundaries where, instead of a straight edge, a stepped edge results. A problem anses 
because current antialiasmg technics operate in linear space while the data is in gamma space. 

One techmque is referred to as "supersampling". This consists of rendering the scene at 
a greater magmfication (e.g. 2x, 3x, etc.) of the intended output resolution. The image is then 
downfiltered to provide the final output image. 
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Another technrnue is known as •Wusampung" and involves renderrng the .mage a, the 
desired output resolution. A numhe, of values are generated for each pixel at different S atnp.e 
pcnts scatteted uniformly throughout the pixel. These values are then filtered to determine rhe 
final output pixel color. 

5 

Each of these methods resultin poor antialiasing because of the lack of compensation 
for the gamma space of the samples. Consider, for example, a two sample multisample method 
used on a black/white edge resulting in samples used having levels at 0% and 1 00% In this 
simple example the filter operation would average the two values with a result of 50%. The 
10 actual output on the display would be 21.8%, an intensity much lower than the desired 50% 
intensity. A second example is a two sample multisample method used on a black/grey edge 
resulting in samples used having levels at 0% and 50%. The filter operation would average the 
two values with a result of 25%. The actual output on the display would be 4.7% an intensity 
much lower than the desired 25% intensity. 



15 



There are other transform functions that operate at less than optimal effect when 
performed on gamma space data, including some blending operations and some texture 
operations. 
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a l M p A B V OF TM B INVENTION 

The present invention provides a solution to the problems of performing 
transformation funetions on data originating in gamma spaee and par, of systems that do no, 

5 use, or are not intended .0 use, gamma eorreetion sehemes. The invention provides 

additional stages to a transform b.oek used by a transform function. In the scheme of the 
invention, eaeh input sample has a degamma function (inverse gamma) applied to it to 
transform it from gamma space to linear space, prior ,„ the transform block. The degamma 
function is such as to approximate the transfer taction of a typical monitor. After the 

10 transform operation is applied a. tire transform block to produce a result, a gamma function is 
applied to the result to return the sample to gamma space so that the output sample is ready 
for further processing. 
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Figures 
display system. 



mrrrr pr-nnrnoH ™ ™* ™ awing 



1A though 1C illustrated possible signal to voltage relationships in a computet 



Figure 2 is a block diagram of an embodiment of the present 



invention. 



Figure 3 is a block diagram of an alternate embodiment of the invention. 
Figure 4 is a block diagram of another embodiment of the invention. 
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pmn,pp oEScsffinoM 

The present rnvention provides improved ^formations of gamma spaee da.. In the 
Mowhtg description, n_ specific de* ate se, ford. ,o ptovtde a mote .borough 
5 ^cnpuonofembodhnentaofmemvennon. It is apparent, however, to one skrhed m dte aat, 
me mvention may be practiced without rhese specific detaila. In other inarancea, well 
known features have no. been described in detail ao as not to obseute the invention. 

The present invention provides a method of accomplrshing ^formations in , graphics 
, 0 and display sysrem rha, does no. nse gamma correction of pixeU before provdmg mem » a 
dispby. In me preferred embodiment of dtis mvention, prxel data is p.e-gamma co.rec.ed (i.e. 
in gamma space). 

Figure 2 ra a block diagram of one embothmen, of me preaenr mvention. Image dara 
15 200 in gamm, apace is provided ro a gamma/bnear converston block 201 where i. is 

reformed inro hnear apace. Tins hnear space dara 202 ia then provided ro reformation 
Hock 203. Tire transformation Hock ia a block ma. opera.ea a transform function of some type 
o„ ,he hnear space mrage dara. The .Wormed data 204 is rhen converted back to gamma 
space m hncar/gamma conversron Hock 205 for use by other parra of the gmpHcs processing 
20 system. Example, of me transform operation ma, can be apphed to image data and used with 
Che present invention include anuahasmg srepa, blending operarions, altering operations, and 
odrer convolving steps thar opera.e mom effectively m knear apace man in gamma apace. 
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Another embodiment of the indention is fcttated in the block diagram of Figuae 3. 
fcnage da„ samples 300 ate ptovtded to degatnm, Bite, 30,. IK degamma fiber .mplements 
*. gamm, function of the monttor associated with fire graphics processing system and converts 
Che image data samples fiom gamma space ,o linear space. TTte linear space data is then 
5 provided to transform block 303 fo. applrcafion of the desbed transform function. The hneat 
space outpor 304 is men provided to gamma cottecfion Hock 305 where i, , converted back ro 
gamma space. 

Another embodiment of me ptesent invention provides conversion of gamma space data 
10 ,„ Lneac space data for a reaolvmg opetafion that is pa« of an anfialiasing operafion. Resolving 
1S . step m graphics ptocessmg dtat is used ,o detemfine the co.or of a pixel which may have two 
or more graphics pnmifives falling within me boundaries of the ptxeL The techntoue of 
mulfisampling constats in pat, of takutg a number of samples from withm a pisel and resolvmg 
.hem to a single cob.. The theory is mat by taking multiple samples, the pnmtfive having the 
,5 most area of the pntel will have the most samples, and thus will have me gteates. impact on me 
final resolved color of the pixel when dtsplayed. In one tesolve system, the mulfisamples ate 
pI ovided to , sum and divide urn, to avetage the samp.es and prov.de me destred output colot. 

,„ one embodiment of the present mvention, the samples at. convened ftom gatnma 
20 space to lincat space print to the sum and div.de operafion. The output of mat operation is then 
convened back to the gamm, space and provided to a monitor for display. An esatnple of one 
embodiment of the invention is illusttated in Figure 4. 
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Refe^g to Figure 4, a ptaality of samples 400.1, 400.2 tough 400.n • taken ftom . 
H fa *e mulusamphng process. Each santple is passed tough one of She, 401.1. 401.2, 
^gh 401.„ .o ..ansfom, it fa. gamnra space ,o fines, space. In the ptefced emfiodimen. 
to is accomplished via a degamma cotecdon Bte drat has a nansfomtadon fitncdon is 
5 .heapp— fiega*nnanu,cdonofamoni.o. . 

gmm a fo ncdonof2.2. Each sa.p.e , is nansfonned by appl« tacdon. lb. outputs of 
*, are hneac space values 402,, 402.2, tough 402.U and ace pcovided to me s«a and 
divide block 403. 

, 0 In block 403 the samples ace summed together and then dtvtded to define dae Colo, and 

density of dae pixel Co fie displayed. As noted ahove, da. convcsion Co Unea. space pcovides 
for mo.e accuse andaUasnag fiy avoidhag stepped aud inaccurate ccansidon,. The block 403 - 
one embodiment employs tounding to the sample sums. 

, 5 The output 404 of the sum and divide block 403 is a linear space value that is then 

converted back to gamma space before providing it to a montto. for display. Tins is 
accomphshed ™ gamma correcdon filter 405 whtch applies dr. mve.se of the gamma effect of 
the monito., such as by using funcdon (whe.e dae gamma of the tnonito. is 2.2, fo. 
camp..). The .esul. of tins step is a gamma space value 406 whtch can men be p.ovided to 
20 monitor 407 for display. 

Ahhough no. shown, them may be a frame buff., used ,o store dae output 406 P do. to 
pIovi dmg the value, to monito. 407. Tfie gamma and deg^nma filters can fie implemented via 



LOSANGELES 106606vl 



-12- 



0007057-0034 



look n P tab.es. H. Mtnp table, can be conned fo. vanaes of between ,0 (no 

correction) and 2.5. 

to an — — 0' *« — ^ — ^ " C 8 Wt SamP ' eS ^ 
,nd dH*) - ^ ,0 bi« space end the gatnnta cordon ptovidea an 8 bit on«pnt 

A bypass loop can be deluded in an, of «he to reduce doe need foe 

W dae sunt and dtv.de Hoc,) ate the satne, dtete is no need to petfotn, the ttansfonn opetadon. In 

One en— »bete dns can be used is whete thete is a coupon scheme tha, on, 
15 same and no ttansfotm funcdon is applied (the bypass is enabled). 

Thus, a scbetne fot opdtnianag ttansfonn funchons ha non-gamma cottecdon enabled 
graphics systems has been described. 
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